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PREFACE 


This  volume  is  the  last  of  six  volumes  that  describe  the  LMI  Sortie- 
Generation  Model  System.  Volume  I,  Executive  Summary,  discusses  the  problem 
the  system  is  designed  to  address  and  provides  an  overview  of  the  principal 
parts  of  the  system.  Volume  II,  Sortie-Generation  Model  User' 3  Guide,  pro¬ 
vides  sufficient  information  to  allow  a  user  to  run  the  Sortie-Generation 
Model  (SGM) .  Volume  III,  Sortie-Generation  Model  Analyst's  Manual,  describes 

the  mathematical  structures,  derivations,  assumptions,  limitations,  and  data 

/ 

sources  of  the  system  at  a  very  detailed  level.  Volume  IV,  Sortie-Generation 
Model  Programmer's  Manual,  specifies  the  details  of  the  computer  programs, 
file  structures,  job  control  language,  and  operating  environment  of  the  sys¬ 
tem.  Volume  V  describes  the  maintenance  subsystem  and  explains  the  construc¬ 
tion  of  the  maintenance  input  file  to  the  SGM.  Volume  VI  describes  the  spares 
subsystem  and  shows  a  user  how  to  build  the  spares  file  that  is  used  by  the 
SGM. 

Potential  users  are  cautioned  that  no  volur  .  is  intended  to  provide,  by 
itself,  all  of  the  information  needed  for  a  comprehensive  understanding  of  the 
operation  of  the  SGM. 
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1.  MODEL  DESCRIPTION 


INTRODUCTION 

The  Sortie-Generation  Model  (SGM)  ia  a  hybrid  analytic/simulation  model 
that  estimates  the  expected  maximal  number  of  sorties  that  can  be  flown  by  a 
specified  type  of  tactical  fighter  aircraft  in  a  wartime  scenario.  This 
estimate  is  based  on  aircraft  characteristics,  maintenance  manpower  and 
recoverable  spares  levels,  and  user  inputs  that  describe  the  scenario  of 
interest. 

The  purpose  of  this  volume  is  to  describe  the  mathematical  structures, 
algorithms,  and  assumptions  that  underlie  the  SGM'b  estimates  of  sortie- 
generation  capability.  We  also  discuss,  in  Chapter  5,  our  efforts  to  validate 
the  SGM. 

In  this  chapter,  we  simply  repeat,  for  the  reader's  convenience,  our 
general  description  of  the  SGM  that  is  also  included  in  Volume  II,  Sortie- 
Generation  Model  User' 8  Guide. 

THE  STRUCTURE  OF  THE  MODEL:  STATES  AND  PROCESSES 

The  SGM  consists  of  a  collection  of  aircraft  states,  processes  that  cause 
transitions  between  states,  and  logic  that  governs  those  processes.  The  SGM 
simulates  the  transition  of  aircraft  between  these  states  throughout  a  daily 
flying  schedule  that  is  specified  by  the  user.  The  definitions  of  the  states, 
the  logic  of  the  state  transitions,  and  the  interaction  of  these  transit-ions 
with  the  flying  schedule  determine  the  basic  structure  of  the  SGM. 

Aircraft  States 

There  are  five  aircraft  states  in  the  SGM: 

1)  Mission-capable 

2)  Maintenance 


3)  Not  mission-capable,  supply  (NMCS) 

4)  Combat  loss 

5)  Reserve 

These  states  are  mutually  exclusive  and  collectively  exhaustive;  i.e.,  every 
aircraft  is  in  one  and  only  one  state.  The  states  are  described  below. 

Mission  Capable.  An  aircraft  is  considered  mission-capable  if  it  is 
capable  of  flying  a  combat  mission.  It  is  not  mission-capable  if  it  is  under¬ 
going  essential  corrective  maintenance,  or  is  missing  a  mission-essential 
part.  There  is  no  explicit  representation  in  the  SGM  of  aircraft  that  are 
partially  mission-capable. 

Maintenance .  An  aircraft  is  in  maintenance  status  if  it  requires 
unscheduled,  on-aircraft  repair  that  is  essential  to  the  performance  of  its 
mission.  This  repair  may  or  may  not  be  due  to  failure  of  a  part;  however,  in 
this  model,  an  aircraft  is  not  allowed  to  enter  maintenance  until  all  needed 
parts  have  been  obtained  from  supply  or  repair. 

NMCS.  An  aircraft  is  not  mission-capable,  supply  if  the  aircraft  is 
missing  an  essential  part.  In  the  SGM,  only  mission-essential  Line  Replace¬ 
able  Units  (LRUs)  can  cause  an  aircraft  to  become  NMCS. 

Combat  Loss.  An  aircraft  is  counted  as  a  combat  loss  if  it  does  not 
return  from  a  sortie.  Once  an  aircraft  has  been  lost  it  can  never  be  re¬ 
covered.  Battle-damaged  aircraft  that  return  from  a  sortie  are  not  considered 
in  this  model. 

Reserve .  Reserve  aircraft  consist  of  mission-capable  aircraft  that 
are  used  to  replace  combat  losses.  The  user  specifies  an  initial  number  of 
aircraft  thc.t.  are  held  in  reserve  at  the  beginning  of  the  scenario;  these 
reserve  aircraft  replace  combat  losses  at  the  end  of  each  day,  until  all 


1-2 


reserves  have  been  exhausted.  Aircraft  are  allowed  to  leave  thiB  reserve 
state,  but  no  aircraft  can  enter  it. 

Processes  -  Transitions  Between  States 

There  are  eight  processes  in  the  SGM  which  cause  transitions  between 
aircraft  states: 

1)  Ground  aborts 

2)  Breaks 

3)  Aircraft  repairs 

4)  Parts  demands 

5)  Parts  repair 

6)  Cannibalization 

7)  Attrition 

8)  Commitment  of  reserves 

Figure  1-1  depicts  the  relationships  among  the  various  states  and  processes. 
THE  LOGIC  OF  THE  MODEL:  EVENTS  AND  THEIR  SEQUENCING 

The  events  that  occur  in  the  SGM  are  related  to  a  flying  schedule  with 
user-specified  characteristics.  The  flying  schedule  consists  of  a  number  of 
periods  or  cycles  each  of  which  is  divided  into  three  segments  of  lengths  T^, 
Tj,,  and  Ty,  respectively.  During  the  last  period,  the  Ty  segment  is  replaced 
by  an  overnight  recovery  period.  The  user  specifies  the  first  and  last  take¬ 
off  times  of  the  day;  the  time,  T^,  which  is  the  average  minimal  length  of 
time  required  to  launch  a  sortie  given  a  mission-capable  aircraft;  the  sortie 
length,  Tp',  and  the  number  of  periods  per  day.  The  time,  Ty,  is  then  computed 
by  the  SGM  program.  The  flying  schedule  is  the  same  each  day  except  for  the 
number  of  aircraft  to  be  flown  each  period,  which  the  user  can  vary.  A 
typical  flying  schedule  is  portrayed  in  Figure  1-2. 
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STATES  AND  PROCI 


Figure  1-3  portrays  two  segments  of  a  flying  day;  the  flying  period  on 
the  left  is  intended  to  be  typical  and  the  one  on  the  right  to  be  the  last 
period  of  the  day.  The  events  that  occur  in  the  SGM  are  denoted  by  circled 
numbers  placed  under  the  figures  at  the  appropriate  positions  on  the  time 
line.  Each  of  those  events  is  described  here. 

Event  1 

All  mis sion- cap able  aircraft  are  prepared  for  launch.  Any  aircraft 
that  is  not  mission-capable  at  this  time  (i.e.,  before  takeoff)  cannot  be 
flown  during  this  cycle  because,  by  definition,  is  the  minimal  time  re¬ 
quired  to  launch  an  aircraft  that  is  mission-capable. 

Event  2 

Aircraft  that  are  repaired  during  the  period  of  length  leave 
maintenance  and  become  mission-capable  but  are  not  available  for  flight  during 
this  cycle. 

Event  3 

All  aircraft  that  were  prepared  for  takeoff  are  subjected  to  the 
probability  of  ground  abort.  A  ground  abort  is  defined  as  an  unsuccessful 
attempt  by  an  aircrew  to  fly  an  aircraft.  The  aborted  aircraft  enter  mainte¬ 
nance.  No  parts  demands  are  generated  by  ground  aborts. 

Event  4 

The  remaining  aircraft  that  were  prepared  for  takeoff  fly  sorties. 

Event  5 

Each  aircraft  that  flies  is  subjected  to  the  probability  of  attri¬ 
tion  and,  for  each  combat  loss,  an  aircraft  is  deducted  from  the  current 
strength  of  the  organization. 


1-6 


±,A:U. 


Event  6 


Aircraft  that  are  repaired  during  the  period  of  length  Tp  leave 
maintenance  and  become  mission-capable. 

Event  7 

Each  aircraft  returning  from  flight  is  subjected  to  the  probability 
of  break,  i.e.,  the  probability  of  requiring  essential  corrective  maintenance 
prior  to  flying  another  combat  mission.  At  the  same  time,  parts  demands  are 
generated.  Demands  that  can  be  filled  from  stock  on-hand  result  in  issues  of 
that  stock.  Demands  that  cannot  be  filled  from  stock  and  cannot  be  satisfied 
by  cannibalization  from  aircraft  that  are  NHCS  result  in  additional  aircraft 
becoming  NMCS. 

Event  8 

Aircraft  that  are  repaired  during  the  period  of  length  leave 
maintenance  and  become  mission-capable. 

Event  9 

This  event  occurs  only  after  the  last  flight  of  the  day.  It  ac¬ 
counts  for  the  parts  repair  process  by  subjecting  each  part  in  repair  to  the 
probability  that  the  repair  was  completed  during  the  preceding  24  hours. 
Remaining  parts  shortages  are  consolidated  on  as  few  aircraft  as  possible.  If 
the  consolidation  results  in  fewer  NMCS  aircraft  than  before,  the  aircraft 
leaving  NMCS  status  enter  maintenance  at  this  time. 

Event  10 

This  event  also  occurs  only  after  the  last  flight  of  the  day. 
Combat  losses  may  be  replaced  by  available  reserve  aircraft,  if  the  UBer  so 
specifies.  Any  remaining  reserve  aircraft  after  losses  have  been  replaced  are 
committed  according  to  user  specification  in  the  scenario  input  parameter.  If 
reserves  are  to  be  used  only  as  attrition  fillers,  then  any  remaining  reserve 
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aircraft  are  left  in  the  reserve  pool;  thus,  the  UE  for  the  scenario  will 
never  increase.  If  the  user  has  selected  the  reserve  augmentation  mode,  then 
all  reserve  aircraft  will  be  committed  when  they  become  available;  hence,  the 
UE  for  the  scenario  may  actually  increase. 

THE  REPAIR  PROCESS 

The  entry  of  an  aircraft  into  maintenance  results  from  a  ground  abort  or 
a  "break"  during  a  sortie.  In  either  case,  following  the  ground  abort  or 
sortie,  the  aircraft  is  subjected  to  a  sequence  of  random  draws  that  deter¬ 
mines  the  subset  of  work  centers  that  will  be  involved  in  the  maintenance  on 
that  aircraft.  A  work  center  is  a  set  of  maintenance  personnel  with  a  par¬ 
ticular  skill.  Examples  of  work  centers  are  the  structural  repair  shop,  the 
hydraulic  shop,  and  the  automatic  flight  control  system  shop. 

In  the  construction  of  the  maintenance  data  base  that  supports  the  SGM, 
the  aircraft  repair  times  for  all  work  centers  involved  in  the  repair  of  the 
aircraft  are  measured  from  the  time  of  the  ground  abort  or  landing  of  the 
aircraft.  For  each  work  center  involved  in  the  repair,  a  random  draw  is  made 
from  an  exponential  distribution  of  repair  time  for  that  work  center.  The 
mean  of  that  distribution  is  the  reciprocal  of  the  service  rate  contained  in 
the  maintenance  data  base  for  the  work  center  in  question.  All  work  centers 
involved  in  the  repair  are  assumed  to  work  on  the  aircraft  simultaneously; 
thus,  the  recovery  time  of  the  aircraft  is  simply  the  longest  of  the  repair 
times  for  all  the  work  centers  involved  in  the  recovery  of  that  particular 
aircraft. 

In  the  SOM,  once  the  aircraft  leaves  maintenance  and  becomes  mission- 
capable  again,  it  loses  its  identity  and  is  counted  simply  as  another  aircraft 
in  the  miasion-capable  pool. 
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CHAPTER  2.  AIRCRAFT  MAINTENANCE:  GROUND  ABORTS,  AIRCRAFT 
BREAKS,  AND  AIRCRAFT  REPAIRS 

INTRODUCTION 

In  the  SGM,  eircreft  enter  maintenance  in  one  of  two  ways,  at  a  result  of 
a  ground  abort  or  as  a  result  of  flying  a  sortie.  A  ground  abort  is  an  at¬ 
tempt  by  an  aircrew  to  fly  an  aircraft,  unsuccessful  due  to  a  malfunction  or 
condition  requiring  corrective  maintenance  prior  to  flight.  An  aircraft  break 
is  the  result  of  a  malfunction  during  flight  or  discovery  of  a  condition  after 
flight  that  requires  corrective  maintenance  prior  to  further  flight.  Thus, 
each  aircraft  scheduled  for  flight  or  returning  from  flight  is  subject  to 
entering  maintenance. 

In  this  chapter,  we  discuss  the  algorithms  used  by  the  SGM  to  model 
aircraft  ground  aborts,  malfunctions  or  "breaks"  during  flight,  and  the  re¬ 
pairs  of  aircraft  by  maintenance  work  centers. 

GROUND  ABORTS 

The  ground  abort  algorithm  uses  the  number  of  mission-capable  aircraft 
scheduled  for  flight  as  the  first  parameter  of  a  binomial  distribution,  the 
second  parameter  being  the  probability  of  ground  abort.  With  these  two  param¬ 
eters  given,  a  random  draw  is  made  to  determine  the  value  of  a  binomial  random 
variable  designating  the  number  of  ground  aborts.  This  number  is  passed  to  an 
algorithm  that  determines  the  work  centers  in  the  maintenance  organization 
that  must  perform  maintenance  on  each  of  the  aborted  aircraft.  The  ground 
abort  algorithm  then  reduces  the  number  of  mission-capable  aircraft  that  will 
be  flown  in  the  current  flying  period  by  the  number  of  ground  aborts. 

The  next  step  in  the  process  is  to  determine  the  work  centers  involved  in 
the  repair  of  the  aborted  aircraft.  This  is  accomplished  by  the  sequential 


sampling  algorithm  discussed  in  the  section  entitled  Distributing  Mainte¬ 
nance  Workload. 

No  part  demands  are  generated  by  ground  aborts.  All  part  demands  are 
generated  by  aircraft  breaks  that  occur  after  flight.  The  user  is  able  to 
specify  a  ground  abort  rate  that  remains  constant  throughout  the  scenario  or 
one  that  varies  from  day  to  day. 

AIRCRAFT  BREAKS 

The  user  specifies  the  aircraft  break  rate,  i.e.,  the  probability  that  an 
aircraft  returning  from  flight  needs  to  undergo  unscheduled,  corrective  main¬ 
tenance  prior  to  further  flight.  The  aircraft  break  algorithm  works  es¬ 
sentially  the  same  as  the  ground  abort  algorithm.  A  binomial  random  variable 
is  generated  from  a  distribution  of  which  the  first  parameter  is  the  number  of 
aircraft  returning  from  flight  at  the  end  of  a  flying  period  and  the  second 
parameter  is  the  aircraft  break  rate.  This  model  assumes  that  breaks  among 
aircraft  are  stochastically  independent.  After  determining  the  number  of 
broken  aircraft,  the  SGM  determines  the  numbers  and  types  of  component  demands 
that  resulted  from  these  broken  aircraft.  The  number  of  NMCS  aircraft  is  then 
computed,  and  any  remaining  broken  aircraft  which  are  not  NMCS  are  passed  to 
the  sequential  sampling  algorithm  discussed  in  the  next  section.  The  parts 
demands  and  NMCS  computations  are  described  in  Chapter  3. 

Use  of  maintenance  data  from  the  Air  Force's  maintenance  data  collection 
system  results  in  estimates  of  break  rates  by  work  center  that  are  higher  than 
reality.  Therefore,  work  center  break  rates  (i.e.,  the  proportion  of  broken 
aircraft  on  which  work  is  done  by  individual  work  centers)  in  the  SGM  are 
treated  as  conditional  probabilities  givtn  an  aircraft  break,  rather  than  the 
conditioning  event  being  an  aircraft  sortie.  Thus,  the  aircraft  break  rate  is 
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explicitly  specified  by  the  user  as  an  input  variable  rather  than  being  in¬ 
ferred  from  the  work  center  break  rates. 

DISTRIBUTING  MAINTENANCE  WORKLOAD 

Once  it  is  determined  that  an  aircraft  requires  maintenance,  because  of 
either  a  ground  abort  or  an  aircraft  break,  this  algorithm  determines  the 
particular  work  centers  where  the  aircraft  requires  repair.  It  does  this  by 
generating  a  random  sample  from  among  all  the  possible  ways  an  aircraft  can 
break  into  maintenance.  The  sampling  is  consistent  with  the  work  center  break 
rates . 

This  algorithm  is  a  sequential  sampling  technique  that  deals  iteratively 
with  each  work  center.  Given  that  an  aircraft  has  broken  into  at  least  one 
work  center,  a  random  number  is  drawn  for  each  work  center,  beginning  with  the 
first,  to  answer  the  questions: 

1.  Did  the  aircraft  break  into  this  work  center? 

2.  Did  the  aircraft  break  into  any  other  work  centers  which  have  not  been 
considered  yet? 

If  the  answer  to  the  first  question  is  yes,  the  aircraft  is  "marked"  to  indi¬ 
cate  that  it  has  broken  into  this  work  center.  The  answer  to  the  second 
question  determines  whether  the  algorithm  is  terminated  for  this  aircraft,  or 
continues  with  the  next  work  center. 

The  key  assumption  in  the  formulation  of  the  algorithm  is  that  breaks 
into  different  work  centers  are  independent,  i.e.,  a  break  into  one  work 
center  does  not  affect  the  probability  of  breaking  into  another  work  center. 
This  independence  assumption  simplifies  modeling  the  probabilities  associated 
with  the  above  questions  and  allows  the  algorithm  to  work  in  an  iterative 
fashion  without  "remembering"  the  outcomes  for  previous  work  centers. 

The  remainder  of  this  section  provides  a  detailed  description  of  the 
algorithm  and  a  proof  that  the  random  samples  generated  are  consistent  with 
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the  probability  distribution  of  the  possible  ways  an  aircraft  can  break  into 
maintenance. 

Given: 

-  A  collection  of  N  work  centers ,  labeled  1,  2,...,  N. 

-  An  aircraft  breaks  into  a  least  one  of  these  work  centers. 

-  B(j )  for  j  *  1,  2, . . . ,N.  B(j)  is  the  probability  that  an  aircraft 
breaks  into  work  center  j .  These  probabilities  are  assumed  to  be 
independent. 

Determine: 

-  A  random  sample  of  the  work  centers  where  the  aircraft  requires 
repair. 

Approach 

This  algorithm  is  an  iterative  sampling  technique  that  deals 

sequentially  with  each  work  center  j:  j  a  1,  2,...,  N,  until  termination  is 

indicated.  The  jth  iteration  proceeds  as  follows:  Assume  that  the  aircraft 

has  broken  into  at  least  one  of  the  work  centers  in  the  set  {j,  j  +  1,  j  + 

2,...,  N}.  (Clearly  this  assumption  holds  for  the  first  iteration,  j  *  1.) 

Then  one  of  the  following  situations  must  exist: 

Event  A.  :  The  aircraft  has  broken  into  work  center  ,1 ,  but  has  not 

^  broken  into  any  of  the  work  centers  in  the  set  {j  +  1, 

j  *  2, . . . ,  N} . 

Event  B.  :  The  aircraft  has  broken  into  work  center  j  and  also 
^  broken  into  at  least  one  of  the  work  centers  in  the  set 
{j  *  1*  j  2,...,  N}. 

Event  C.  s  The  aircraft  has  not  broken  into  work  center  j,  but  it 

^  has  broken  into  at  least  one  of  the  work  centers  in  the 

set  {j  +  1,  j  +  2, . . . ,  N } . 

Given  the  probabilities  of  these  events,  a  random  sample  can  be  generated  to 
determine  which  situation  applies.  The  results  of  this  sample  determine  the 
answers  to  the  following  questions: 

1.  Did  the  aircraft  break  into  work  center  j? 
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2.  Did  the  aircraft  break  into  any  of  the  remaining  work  centers,  {j 
+  1,  j  +  2,...,  N>? 

The  first  question  determines  whether  the  aircraft  is  marked  as  having  broken 
into  work  center  j;  the  second  question  determines  whether  the  algorithm 
terminates  for  this  particular  aircraft,  or  continues  with  the  next  work 
center.  The  algorithm  proceeds  as  follows: 

Step  0:  Initialize  probabilities  for  each  work  center. 

Calculate  the  following  probabilities  for  each  work  center, 
j*l,2, . . . ,N; 

PMASK(j)  =  Probability  that  an  aircraft  breaks  into  work  center  j, 
given  it  has  broken  into  at  least  one  of  the  work  centers 

in  U.  i  *  1.....  N}, 

N 

*  B(j)  /  {1  -  n  [1-B(k)ih 
k»j 

PSTOP(j)  *  Probability  that  an  aircraft  has  broken  into  work  center 
j  but  has  not  broken  into  any  of  the  work  centers  in  the 
set  {j  +  f,  j  +  2,...,  N},  given  that  the  aircraft  has 
broken  iuto  at  least  one  of  the  work  centers  in  { j ,  j  + 
l,...,  N} , 

N 

=  PMARKCj ) {  n  [ l-B(k) ] } . 
k=j+l 

(Note:  PSTOP(N)  *  PMARK(N)  *  1) 

PMARKCj)  and  PSTOP(j)  represent  points  in  the  cumulative  distribu¬ 
tion  function  of  the  events:  ,  Bj  ,  and  C j .  Specifically,  PSTOP(j)  equals 

the  probability  of  event  Aj  for  an  aircraft  which  is  given  to  have  broken  into 
at  least  one  of  the  work  centers  { j ,  j  +  1,...,  N }  and  PMASK(j)  equals  the  sum 
of  the  probabilities  of  Aj  and  Bj .  In  this  algorithm,  a  uniform  (0,  1)  random 
draw  is  compared  with  these  probabilities  to  determine  a  random  sample  from 
among  the  three  possible  events  for  work  center  j. 

Note  that  the  above  formulae  are  based  on  the  assumption  that  the 
break  probabilities,  are  independent.  Also,  PSTOP(N)  equals  1,  since 
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Ajj  is  the  only  possible  event  for  work  center  N;  i.e.,  there  are  no  more  work 
centers  in  which  the  aircraft  may  require  repair. 

The  break  probabilities,  {B(j)j,  for  the  various  work  centers  are 
assumed  to  remain  constant  throughout  the  scenario;  consequently,  Step  0  needs 
to  be  executed  only  once  at  the  beginning  of  the  simulation. 

The  main  loop  of  this  algorithm  consists  of  three  steps  which  are 
executed  for  each  work  center,  j  a  i,  2,...,  N,  until  termination  is  indi* 
cated.  The  steps  are: 

Step  1:  Generate  a  uniform  (0,  1)  random  number,  U. 

This  random  draw  determines  which  of  the  three  possible  events  has 
occurred  for  work  center  j .  The  determination  is  made  in  Steps  2  and  3  and  is 
based  on  where  the  random  draw  falls  in  the  cumulative  distribution  of  these 
events : 

0  <  U  S  PSTOP(j)  implies  Event  Aj 

PSTOP(j)  <  U  n  PMARK(j)  implies  Event  Bj 

PMARK(j)  <  U  S  1  implies  Event  Cj 

Step  2:  Determine  if  the  aircraft  has  broken  into  work  center  j. 

If  U  >  PMARK(j),  then  increment  the  work  center  index  j,  and  return 

to  Step  1. 

If  U  S  PMARX(j),  then  "mark"  the  aircraft  as  having  broken  into  work 

center  j . 

If  the  random  draw  indicates  Event  Cj ,  i.e.,  U  >  PMABK(j),  then  the 
aircraft  did  not  break  into  work  center  j,  but  it  does  require  repair  in  at 
least  one  of  the  remaining  work  centers,  {j  +  1,  j  +  2,...,  N}.  Therefore, 
the  algorithm  continues  with  the  next  work  center. 

If  Event  Cj  is  not  indicated,  then  either  Event  Aj  or  Event  Bj 
occurs.  Both  of  these  situations  imply  that  the  aircraft  has  broken  into  work 


center  j.  A  further  test  will  be  made  in  Step  3  to  distinguish  between  these 
two  remaining  possibilities. 

Step  3:  Determine  if  the  aircraft  has  broken  into  any  of  the 
remaining  work  centers. 

If  U  >  PSTOP(j),  inclement  the  work  center  index  j,  and  return  to 

Step  1 . 

If  0  S  PSTOP(j),  stop. 

If  Event  Aj  or  Event  Bj  was  indicated  in  Step  2,  another  test  is 
needed  to  distinguish  between  these  two  events.  If  the  random  draw  indicates 
Event  B.,  i.e.,  U  >  PSTOP(j),  the  aircraft  has  broken  into  one  of  the  remain- 

J 

ing  work  centers,  {j  +  1,  j  +2,...,  N}.  Hence,  the  algorithm  continues  with 
the  next  work  center. 

If  Event  Aj  is  indicated,  then  work  center  j  is  the  last  work  center 
in  which  this  aircraft  requires  repair;  and  the  algorithm  is  terminated  for 
this  aircraft.  Note  that  the  algorithm  can  only  terminate  at  a  work  center  in 
which  the  aircraft  requires  repair,  thus  ensuring  that  it  always  breaks  into 
at  least  one  work  center.  The  algorithm  is  also  guaranteed  to  stop  eventually 
since  PSTOP(N)  =  1.  A  flow  chart  of  the  algorithm  is  shown  in  Figure  2-1. 
SIMULATING  AIRCRAFT  REPAIRS 

This  section  describes  an  algorithm  for  simulating  the  number  of  aircraft 
repaired  in  a  work  center  during  a  time  period  of  specified  length.  In  the 
Sortie-Generation  Model,  aircraft  repair  is  modeled  as  a  multiple-server 
queuing  process.  A  work  center  consists  of  a  specified  number  of  servers  or 
crews  that  perform  unscheduled  maintenance  on  aircraft  that  break  into  the 
work  center.  Each  crew  within  a  work  center  haa  an  independent  and  identical 
exponential  service-time  distribution.  No  crew  i3  ever  idle  while  an  aircraft 
is  waiting  for  service,  i.e.,  if  there  is  a  queue,  then  all  crews  are  buay. 
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In  addition,  aircraft  are  assumed  to  enter  the  work  center  only  at  the  be¬ 
ginning  or  end  of  a  period.  Under  these  assumptions,  the  number  of  aircraft 
repaired  in.  the  work  center  is  a  random  variable  whose  probability  distribu¬ 
tion  is  dependent  only  on: 

1.  the  number  of  aircraft  in  the  work  center  at  the  start  of  the  period, 

2.  the  number  of  crews, 

3.  the  service  rate  for  these  crews,  and 

4.  the  length  of  the  period. 

Note  that  the  number  of  aircraft  repaired  does  not  depend  on  how  long  any 
aircraft  has  been  in  the  work  center  prior  to  the  start  of  the  repair  period, 
nor  on  the  queuing  discipline  (order  of  service)  employed  in  the  work  center. 
The  purpose  of  this  algorithm  is  to  generate  a  random  sample  of  the  number  of 
aircraft  repairs  that  is  consistent  with  the  probability  distribution  of  the 
corresponding  random  variable.  For  a  detailed  discussion  of  the  output  from 
this  type  of  queuing  process,  see  [14], 

The  sampling  technique  employed  by  this  algorithm  is  determined  by  the 
state  of  the  system  at  the  start  of  the  period.  If  the  number  of  aircraft  in 
a  work  center  does  not  exceed  the  number  of  servers  in  the  work  center,  then 
all  aircraft  are  being  serviced  at  the  start  of  the  period,  and  the  number  of 
aircraft  repaired  is  a  binomially  distributed  random  variable.  A  random 
sample  is  generated  from  a  binomial  distribution  for  which  the  firBt  parameter 
is  the  number  of  aircraft  in  the  work  center  at  the  start  of  the  period  and 
the  second  parameter  is  the  probability  that  any  single  aircraft  will  be 
completed  during  the  period. 

If  one  or  more  aircraft  are  waiting  foe  service  at  the  start  of  the 
period,  the  number  of  aircraft  repaired  during  the  period  is  not  binomially 
distributed.  In  this  case,  all  crewa  will  be  busy  for  at  least  some  portion 
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of  the  repair  period  —  possibly  the  entire  period.  If  all  crews  are  busy 
throughout  the  period,  the  time  between  aircraft  repairs  in  the  work  center  i.s 
an  exponentially  distributed  random  variable.  An  approach  to  modeling  this 
system  is  to  generate  samples  from  the  exponential  distribution  of  time 
between  repairs.  Each  of  these  "inter-repair"  times  represents  an  aircraft 
repair  and  their  sum  indicates  the  elapsed  time  in  the  repair  period.  The 
sampling  is  continued  until  either  the  elapsed  time  exceeds  the  length  of  the 
repair  period  or  enough  aircraft  are  repaired  so  that  a  crew  becomes  idle. 
Once  the  first  crew  becomes  idle,  a  binomial  random  sample  can  be  generated  to 
determine  how  many  of  the  remaining  aircraft  are  repaired  by  the  end  of  the 
period. 

Given: 

A  a  Number  of  aircraft  in  the  work  center  at  the  start  of  the  repair 
period.  (A  is  a  non-negative  integer.) 

r  =  Service  rate  (in  aircraft  per  hour)  of  each  server;  it  is  the  re¬ 
ciprocal  of  the  mean  of  the  exponential  service-time  distribution. 

s  *  Number  of  servers  or  crews  in  the  work  center,  (s  is  a  positive 
integer. ) 

t  a  Length  (in  hours)  of  the  repair  period. 

Determine; 

R  =  Random  sample  of  the  number  of  aircraft  repaired  in  the  work  center 
during  the  repair  period.  (R  is  an  integer  such  that  0  £  R  S  A.) 

Approach 

The  sampling  technique  used  is  determined  by  the  state  of  the  system 
at  the  start  of  the  repair  period: 

CaBe  1.  The  number  of  aircraft  in  the  work  center  at  the  start 
of  the  period  does  n  t  exceed  the  number  of  servers,  that 

is,  A  §  r 
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Ia  this  case,  each  aircraft  is  being  serviced  by  a  repair  crew  at 
the  start  of  the  period.  The  service  time  for  each  crew  is  exponentially 
distributed;  hence,  the  probability  of  an  aircraft  completing  service  during 
the  period  depends  only  on  the  length  of  the  period  and  the  service  rate  of 
the  crew. 

The  probability  that  a  particular  aircraft  is  repaired  during  the 

•  ft 

period,  given  that  it  is  in  service  at  the  start  of  the  period  is  1  -  e 
Thus,  each  aircraft  in  the  work  center  at  the  start  of  the  period  constitutes 
a  Bernoulli  trial,  the  probability  of  completing  service  being  equal  to 

•  ft 

1  -  e  .  Since  all  crews  are  working  independently,  the  random  variable, 
total  aircraft  repairs,  is  equivalent  to  the  sum  of  A  independent,  identical 
Bernoulli  trials,  i.e.,  a  binomially  distributed  random  variable.  Hence,  the 
sampling  procedure  for  Case  1  consists  of  generating  a  random  sample  from  a 

•  ft 

binomial  distribution  with  parameters  A  and  1  -  e 

Case  2.  One  or  more  aircraft  are  waiting  for  service  at  the  start 
of  the  period,  i.e.,  A  >  s. 

In  this  situation,  all  s  crews  will  be  busy  for  at  least  some  por¬ 
tion  of  the  repair  period  —  possibly  the  entire  period.  As  long  as  a  partic¬ 

ular  crew  is  busy,  the  time  between  aircraft  repairs  for  that  crew  is 
distriouted  exponentially  with  oarameter  r  during  that  busy  period.  Further¬ 
more,  if  all  s  crews  are  busy  for  a  given  interval,  the  time  between  aircraft 
repairs  for  the  entire  work  center  is  distributed  exponentially  with  parameter 
rs  during  that  interval  [6 : 284] .  This  exponential  distribution  will  apply 
until  one  of  the  crews  completes  a  repair  and  finds  no  more  aircraft  to  fix, 
i.e.,  when  exactly  s-1  aircraft  remain,  or  equivalently,  when  A-(s-l)  aircraft 
have  been  repaired. 

Thus,  the  approach  for  Case  2  is  to  generate  a  sequence  of  random 

draws,  T^,  T2,...,  from  an  exponential  distribution  with  parameter  rs  to 
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simulate  the  inter-repair  time  between  successive  aircraft,  repairs  in  the  work 
center.  Each  of  these  draws  represents  the  completion  of  an  aircraft  repair 
and  the  sum  of,  say,  k  of  them  indicates  the  elapsed  time  required  for  k 
aircraft  repairs.  This  sequence  is  continued  until  one  of  the  following 
situations  occurs: 

1.  The  total  elapsed  repair  time  exceeds  the  length  of  the  period, 
i.e.,  Tj  +  T2  +  . . •  t  >  t,  or 

2.  A  server  becomes  idle,  i.e.,  exactly  A-(a-l)  aircraft  have  been 
repaired. 

If  situation  1  occurs  first,  then  the  simulated  number  of  aircraft  repairs  is 
the  number  of  repairs  completed  before  the  last  exponential  draw  caused  the 
sum  of  inter-repair  times  to  exceed  the  length  of  the  repaired  period,  i.e., 
R  =  k-1. 

If  situation  2  occurs  first,  then  A-(s-l)  aircraft  have  been  re¬ 
paired  in  time  Tj  =  T1  +  T2  +  ...  +  Ta-(b-1)>  &nd  8“1  aircra*t  are  still  being 
serviced.  Since  Tj  <  t,  there  is  still  a  time  interval  (t-Tj)  left  in  which 
to  repair  these  remaining  aircraft.  Due  to  the  memoryless  property  of  the 
exponential  distribution  of  service  times,  we  now  have  the  same  situation  as 
when  all  remaining  aircraft  are  in  service  at  the  beginning  of  a  time 

interval.  Hence,  we  can  generate  a  random  sample,  Rj,  from  a  binomial  dis- 

-r(t-T  ) 

tribution  with  parameters  s-1  and  1-e  v  I'  to  determine  how  many  of  the 
remaining  s-1  aircraft  are  repaired,  and  set  R  equal  to  Rj  +  A-(s-l).  This 
sequential  sampling  process  is  a  combination  of  several  well  known  techniques 
for  generating  random  variates  (2:203-204,  224]. 

Using  the  inverse  transformation  method,  an  inter-repair  time  sample 
from  an  exponential  distribution  with  parameter  rs  is  given  by: 

Tt  =  -(l/rs)loge(U.), 
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where  IL  is  a  random  draw  from  a  uniform  (0,  1)  distribution.  Thus,  total 
elapsed  repair  time  can  be  written  in  the  form: 

T  +  T  +  .  +  T 

*  l-Cl/rsUog^]  +  [-(l/rs)logeU2l  +  ...  +  [-(l/rs)logeUk] 

*  -(l/rs)loge(UjU2  ...  Uk), 

where  are  independent  samples  from  a  uniform  (0,  1)  distribu¬ 

tion.  The  algorithm  termination  test  can  be  restated  as  follows: 

Tj  +  T2  .. .  +  Tk  >  t, 

which  implies  -(l/rsUog^U^  . ..  U^)  >  t, 

or  UXU2  ...  \  <  e"r8t. 

Thus,  the  algorithm  generates  a  sequence  of  uniform  (0,  1)  samples  until  their 

Ml  4* 

cumulative  product  no  longer  exceeds  e  . 

If  A-(s-l)  aircraft  are  repaired  before  the  end  of  the  period,  then 
Tj f  the  time  at  which  the  first  server  became  idle,  is  easily  calculated  from 
this  cumulative  product: 

TI  *  T1  ♦  T2  *  '  • '  "  V(.-l) 

•  -(l/M)l»l,W1Ul  ... 

Algorithm  1:  Work  Center  Queue  is  Empty,  i.e.,  A  S  s. 

Step  1:  Generate  the  random  sample  r  from  the  appropriate 

binomial  distribution. 

(a)  Generate  s  random  sample  from  a  binomial  dis¬ 
tribution  with  parameters  A  and  l-e~rt. 

Algorithm  2:  Work  Center  Queue  is  Not  Empty,  i.e.,  A  >  s. 

Step  0:  Initialize  aircraft  repaired  and  total  elapsed  repair 
time  to  zero. 

(a)  Set  R  =  0  and  P  =  1. 
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Step  1:  Generate  next  aircraft  inter-repair  time  and  update 
elapsed  repair  time. 

(a)  Generate  random  draw  U  from  uniform  (0,  1) 

distribution. 

(b)  Set  P  ■  P  •  1). 

Step  2:  Determine  if  this  next  aircraft  was  repaired  before 
the  end  of  the  repair  period. 

(a)  If  P  <  e’r8t,  the  algorithm  is  terminated;  R 

contains  number  of  aircraft  repaired  during  this 
repair  period. 

(b)  If  P  Si  e"rst,  set  R  *  R  +  1;  continue  with  Step 

3.  .  .  ...... 

Step  3:  Determine  if  enough  aircraft  have  been  repaired 

so  that  a  server  has  just  become  idle. 

(a)  If  R  <  A  -  (a-l),  return  to  Step  1. 

(b)  If  R  *  A  -  (s-1),  continue  with  Step  4. 

Step  4:  Compute  the  time  at  which  the  first  server  became 

idle. 

(a)  Set  Tj  =  -(1/rs)  •  loge(P). 


Step  5:  Determine  how  many  of  the  remaining  aircraft  are 
repaired  before  the  end  of  the  period. 

(a)  Generate  a  random  sample  Rj  from  a  binomial 
distribution  with  parameters  (s-1)  and 
i 

(b)  Return  R  *  Rj  +  A- (s-1)  as  the  number  of  air¬ 
craft  repaired. 
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3.  AIRCRAFT  SPARES:  PARTS  DEMANDS,  PARTS  REPAIRS 
AND  CANNIBALIZATION 


INTRODUCTION 

In  this  chapter,  we  discuss  the  algorithms  used  by  the  S6M  to  model 
demands,  repairs,  and  cannibalization  of  aircraft  parts.  The  SGM  abstracts 
these  processes  to  the  extent  that  it  generates  demands  for  parts  without 
regard  to  the  work  centers  involved  in  aircraft  repair.  Nevertheless,  the 
parts  demand  rates  and  maintenance  workload  distribution  in  the  model  are 
consistent  with  the  input  data  derived  from  the  various  Air  Force  data  sources 
used  and  are  consistent  with  each  other  except  within  an  aircraft  tail  number. 
These  relationships  are  explained  in  detail  in  the  discussion  that  follows. 

The  principal  purpose  of  the  algorithms  discussed  here  is  to  constrain 
sortie  production  by  estimating  accurately  the  number  of  aircraft  that  are  in 
"not  mission  capable,  supply"  (NMCS)  status  at  any  point  in  time.  The  problem 
is  to  make  that  constraining  effect  consistent  with  the  original  budget  level 
established  by  the  user  in  the  Interactive  Budget  Allocation  Program  so  that 
the  sortie-generation  profile  produced  by  the  SGM  reflects  the  effect  of  that 
budget  level  realistically. 

PARTS  DEMANDS 

Initialization 

At  the  start  of  the  simulation,  the  SGM  initializes  the  supply 
posture  of  each  part,  i.e.,  it  determines  the  number  of  parts  of  each  type  in 
resupply.  By  resupply  we  mean  bsse  repair,  depot  repair  (including  retrograde 
shipment),  and  in  transit  from  depot  to  base  (order  end  ship  pipeline).  In 
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the  SGM,  parts  in  transit  are  modeled  as  being  in  depot  repair.  The  initial¬ 
ization  is  done  by  generating  a  Poisson  random  variate  for  each  component  from 
a  distribution  for  which  the  mean  is  the  expected  number  in  resupply.  If  this 
number  is  not  zero,  it  becomes  the  first  parameter  of  a  binomial  random  var¬ 
iate  that  is  then  generated  for  each  part  type  to  determine  the  number  of 
parts  in  depot  repair  and  in  transit  from  depot  to  base.  The  rest  of  the 
parts  are  then  assigned  to  base  repair.  The  second  parameter  of  the  binomial 
random  variate  denoting  the  number  to  be  assigned  to  depot  repair  and  in- 
tranait  is  given  by 

.  » -  «(s,  *  . 

p "  ftj  +  <1  -  fmw  +  t0) 

where  f  =  the  base  repair  fraction  (1  -  NRTS  rate), 
t  =  depot  delay  time, 
tQ  =  order-and-ship  time,  and 
t^  -  base  repair  time. 


The  NMCS  Computation 

The  SGM  assumes  perfect  cannibalization  when  translating  the  number 
of  parts  of  each  type  in  resupply  to  the  number  of  NMCS  aircraft.  The  number 


of  NMCS  aircraft  is  given  by 


M  _  max 
"  "  i 


max(Vi  “  ns,i’  0) 


where  i  denotes  the  ith  part  type, 

n  ,  =  the  stock  level  of  part  type  i, 
s ,  1 

n  .  *  the  number  of  part  type  i  in  resupply, 

=  the  quantity  per  aircraft  of  part  type  i,  and 
P x”| ®  the  smallest  integer  greater  than  or  equal  to  x. 


Thus,  the  number  of  NWCS  aircraft  is  simply  the  greatest  number  of  shortages 
of  any  one  part  type. 


The  assumption  of  perfect  cannibalization  is  not  realistic;  however, 
it  is  felt  to  be  a  much  better  approximation  to  reality  in  a  wartime  surge  en¬ 
vironment  than  an  assumption  of  a  random  distribution  of  partis  shortages  among 
aircraft. 

Postflight  Parts  Demands 

All  parts  demands  are  assumed  to  occur  after  flight.  Clearly, 
parts  demands  also  occur  between  flights,  after  ground  aborts,  during  pre¬ 
flight,  and  at  other  times,  but  this  simplifying  assumption  has  a  negligible 
effect  on  the  SOM's  estimate  of  sortie-generation  capability  and  dramatically 
reduces  computational  time  by  minimizing  the  number  of  times  during  etch 
simulated  24-hour  period  that  parts  demands  have  to  be  computed.  At  the  end 
of  each  flying  period,  the  computational  algorithm  translates  the  number  of 
"broken"  aircraft  into  the  number  of  demands  for  each  part  type.  In  turn,  the 
number  of  demands  is  translated  into  NMCS  aircraft,  in  the  manner  described 
above . 


The  number  of  parts  demands,  given  a  specified  number  of  broken 
aircraft,  is  computed  as  follows. 

Let  N  ■  a  random  variable  denoting  the  total  number  of  part* 
demands  generated  during  a  flying  period, 

P(3)  =  the  probability  that  an  aircraft  breaks,  given  that  it 
flies  a  sortie  and  returns, 

n  =  the  number  of  different  part  types, 

*  the  quantity  per  aircraft  of  part  type  i, 

P(D.)  =  the  probability  of  a  demand  for  a  component  of  type  i, 
given  that  it  is  installed  on  an  aircraft  that  flies  a 
sortie  and  returns, 

X.  a  a  random  variable  denoting  the  total  number  of  demands  in 
a  flying  period  for  part  type  1,  and 
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k  =  the  number  of  broken  aircraft. 

We  assign  to  X^  a  binomial  distribution  with  parameters  kq^  and 


P(D.)/P(B).  Then, 


N  =  2  X. . 

1=1  1 

The  demands  among  parts  of  different  types  are  assumed  to  be  independent. 
Therefore,  the  expected  value  of  N  is  given  by 


•  • 
n 

n  f  1 

E(N)  a  E 

2  X. 

*  l  E(x.) 

Li-1  lJ 

i-1  L  *  J 

n 

.  r 

1  u  n 

a  2 
i= 

similarly,  the  variance 

of  N  is  equal  to 

m  m 

n 

n  r 

V(N)  »  V 

2  X. 

*  2  V(X.) 

.1*1  1J 
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=  j^P(D1>/P(B)j  \l  -  P(Di)/P(B)J 

=  -J5—  I  q.P(D.)  |P(B)  -  PCD.)]  . 

P‘(B)  1=1  1  1  L  iJ 


If  E(N)  2  20,  we  invoke  the  Central  Limit  Theorem  and  approximate 
the  distribution  of  N  with  a  normal  distribution  (with  continuity  correction) 
whose  mean  and  variance  are  as  shown  above.  We  also  ensure  that 

OSNSk  2  q.. 

i=l  1 


If  E(N)  <  20,  we  approximate  itB  distribution  with  a  Poisson  random  variate 
with  parameter  E(N) . 
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Given  a  value  of  N,  it  remains  to  distribute  the  N  demands  over  the 
n  part  types.  This  is  done  as  follows: 

1.  Partition  the  unit  interval  into  n  subsets,  with  subset  i  of 
size 

?i s  qiri/j!1  Vr  1  a  u  2*  •••’ n> 

where  r^  =  hourly  demand  rate  of  part  i  times  sortie  length 

2.  Generate  K  random  variates  that  are  uniformly  distributed  on 
the  unit  interval;  use  these  values  to  select  the  N  parts  that 
experience  demands. 

Since  n  is  large  and  p^  is  small  for  any  i,  the  approximation  is 

excellent. 

The  only  time  at  which  repairs  of  parts  can  he  completed  is  after 
the  last  flight  of  the  day.  After  determining  parts  demands  that  occur  as  a 
result  of  the  last  flying  period,  the  SGM  determines  the  numbers  and  types  of 
parts  that  are  received  from  base  and  depot  repair.  This  process  is  described 
in  the  section  that  follows. 

Also,  after  the  last  flight  of  the  day,  another  set  of  random  var- 
iates  1b  generated  to  decide  how  many  parts  of  each  type  that  failed  that  day 
are  sent  to  the  depot  for  repair  and  how  many  are  repaired  at  the  base.  For 
each  part,  a  random  variate  is  generated  from  a  uniform  distribution  on  the 
unit  interval  and  compared  to  the  not-repairable-this-station  (NRTS)  rate  for 
that  part  type.  Based  on  these  outcomes,  two  arrays  are  updated,  one  reflect¬ 
ing  the  number  of  each  part  type  in  base  resupply  and  the  other  the  number  in 
depot  resupply. 

Finally,  the  number  of  current  backorders  for  each  part  type  is  used 
to  update  the  number  of  NMCS  aircraft. 
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PARTS  REPAIRS 


Once  each  day,  after  the  last  flying  period,  parts  are  allowed  to  com¬ 
plete  repair  and  be  installed  in  NMCS  aircraft  or  returned  to  the  shelf,  ready 
for  issue.  The  distributions  assigned  to  both  depot  and  base  repair  times  are 
exponential  with  means  derived  from  the  DG41  system.  The  exponential  assump¬ 
tion  is  equivalent  to  the  assumption  of  an  arrival  rate  of  parts  from  repair 
directly  proportional  to  the  number  of  parts  of  each  type  in  repair.  The 
exponential  assumption  was  made  because  of  the  distribution's  memoryless 
property,  thus  allowing  the  SGM  to  account  only  for  the  numbers  of  parts  of 
each  type  in  resupply  at  the  depot  and  at  the  base,  and  because  no  need  then 
exists  to  keep  track  of  the  time  at  which  a  part  entered  resupply.  The  as¬ 
sumption  is  unrealistic  in  scenarios  in  which  transportation  or  repair  capac¬ 
ity  is  seriously  constrained  but  is  reasonable  in  most  other  cases  and 
provides  dramatic  reductions  in  running  times  over  distributions  requiring 
storage  of  repair  starting  times  for  individual  parts. 

In  determining  the  number  of  repairs  of  each,  part  type  completed  at  the 
end  of  a  simulated  flying  day,  the  SGM  generates  two  random  draws  from  bi¬ 
nomial  distributions  for  each  part  type  in  resupply,  either  at  depot  or  base. 
The  first  draw  determines  the  number  returned  from  the  depot;  the  second  draw, 
the  number  from  base  repair.  The  first  parameter  of  the  binomial  distribution 
involved  is  the  number  of  parts  of  that  given  type  in  resupply,  whether  depot 
or  base;  the  second  parameter  is  the  probability  of  return  from  repair  (depot 
or  base)  during  the  24-hour  day  just  ending. 

Subsequent  to  this  sampling,  the  SGM  updates  the  number  of  parts  of  each 
type  in  each  echelon  of  repair,  updates  the  backorders  for  all  part  types,  and 
recomputes  the  number  of  NMC3  aircraft. 
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4.  ATTRITION  AND  AIRCRAFT  RESERVES 

INTRODUCTION 

This  chapter  describes  the  SGM  treatment  of  aircraft  attrition  due  to 
combat  losses  and  the  replacement  of  these  losses  with  available  reserve 
aircraft. 

COMBAT  ATTRITION 

For  purposes  of  estimating  sortie-generation  capability,  there  are 
actually  two  dramatically  different  kinds  of  aircraft  combat  attrition.  The 
first  is  simply  the  loss  of  an  aircraft  on  a  mission,  i.e.,  its  failure  to 
return  from  a  flight.  The  second  kind  involves  the  return  of  an  aircraft  to 
its  home  base  coupled  with  the  loss  of  the  future  use  of  the  aircraft  for  a 
relatively  long  period  of  time,  perhaps  the  entire  length  of  the  scenario  of 
interest,  owing  to  combat  damage.  The  importance  of  the  distinction  lies  in 
the  fact  that  the  combat-damaged  aircraft  typically  yields  a  fairly  complete 
range  of  spare  parts  for  other  aircraft  (complete  except  for  parts  that  were 
damaged  and  parts  that  are  not  interchangeable  among  aircraft).  In  addition, 
these  aircraft  require  a  different  mix  of  maintenance  skills  and  spares  to 
repair  than  do  aircraft  that  fly  sorties  and  return  without  combat  damage  (see 
[5]  and  [9]).  The  SGM  treats  only  the  first  type  of  combat  attrition.  We 
assume  no  combat-damaged  aircraft  ever  return  to  the  base. 

The  SGM  implements  combat  attrition  as  a  binomial  sampling  process.  At 
the  end  of  each  sortie  period,  a  random  sample  is  generated  from  an  appropri¬ 
ate  binomial  distribution  to  determine  the  number  of  combat  losses  among  the 
aircraft  which  flew  the  mission.  These  combat  losses  are  then  subtracted  from 
the  current  strength  of  the  organization;  however,  each  is  counted  as  having 
flown  a  sortie  for  that  particular  period.  The  parameters  of  the  binomial 
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distribution  for  determining  the  combat  losses  consist  of  a  user-specified 
attrition  probability  and  the  number  of  aircraft  that  flew  on  a  particular 
mission.  Thus,  the  attrition  of  aircraft  during  a  mission  is  implemented  as  a 
collection  of  independent  Bernoulli  triala  with  the  attrition  of  one  aircraft 
during  a  sortie  having  no  effect  on  the  possible  attrition  of  other  aircraft 
flying  the  same  mission. 

The  attrition  probability  is  specified  by  the  user  for  each  day  of  the 
flying  scenario.  Thus,  the  user  can  tailor  the  dally  attrition  rates  to 
represent  the  effect  of  previously  flown  sorties.  A  typical  wartime  scenario 
would  probably  assume  higher  attrition  rates  during  the  initial  stages  of  the 
conflict,  declining  to  some  lower  rate  as  air  superiority  ia  achieved  or 
tactics  are  adjusted.  The  attrition  rates  remain  constant  in  the  SGM  during  a 
flying  day,  i.e.,  each  wave  is  subject  to  the  same  attrition  probability; 
however,  this  limitation  ia  for  convenience  of  data  input  only.  The  SOM  could 
be  easily  modified  to  use  different  attrition  rateB  for  each  mission  of  the 
day. 

It  should  be  noted,  of  course,  that  the  assumption  of  an  attrition  rate 
that  ia  independent  of  the  sorties  generated  thus  far  in  the  conflict  is 
somewhat  naive.  Presumably,  the  more  sorties  flown  to  eliminate  counter-air 
capability,  the  lower  the  attrition  one  might  expect  subsequently,  i.e.,  an 
earlier  sortie  is  somehow  more  important  than  a  sortie  flown  later  in  the 
scenario.  Thus,  the  attrition  rate  could  reasonably  be  modeled  as  some  func¬ 
tion  of  total  sorties  generated  thus  far.  This  might  also  provide  a  better 
estimate  of  the  sortie-generation  capability  for  the  specified  logistic 
resources. 
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Including  attrition  in  a  flying  scenario  has  a  significant  impact  on  the 
comparison  of  the  sortie-generation  capabilities  inherent  in  different  logis¬ 
tic  resource  mixes.  It  is  characteristic  of  a  constant  attrition  rate  that 
the  expected  total  number  of  sorties  flown  is  equal  to  the  total  force  size 
divided  by  the  attrition  rate.  Thus,  although  increases  in  logistic  resources 
can  make  significant  differences  in  sortie-generation  capability,  the  expected 
total  number  of  sorties  flown  is  a  function  of  the  attrition  rate  alone. 
Figure  4-1  illustrates  this  impact  of  attrition  upon  the  sortie  profile.  Two 
profiles  estimated  from  different  resource  mixes  are  shown.  Obviously,  the 
better  mix  yields  a  much  higher  sortie  rate  early  in  the  conflict;  however,  as 
attrition  takes  a  greater  toll  on  the  better  mix,  the  sortie  profiles  cross 
and  the  second  mix  begins  to  produce  more  sortieB.  Thus,  at  the  end  of  the 
30-day  period,  both  resource  mixes  have  produced  nearly  the  same  total  number 
of  sorties,  even  though  one  resource  mix  is  obviously  better  than  the  other. 
RESERVE  AIRCRAFT 

Reserve  aircraft  consist  of  fully  mission-capable  aircraft  that  are  used 
either  to  replace  combat  losses  or  to  augment  the  organization's  current 
aircraft  strength  during  the  flying  scenario.  These  reserves  represent  re¬ 
placement  aircraft  that  are  flown  in  each  day.  They  are  assumed  to  arrive  in 
a  fully  mission-capable  status,  and  once  a  reserve  has  been  committed,  it 
cannot  return  to  reserve  status,  i.e.,  aircraft  are  allowed  to  leave  the 
reserve  state,  but  no  aircraft  can  enter  it. 

At  the  start  of  each  SGM  simulation,  the  user  specifies  how  reserves  are 
to  be  committed  throughout  the  scenario.  Reserves  can  be  used  as  "attrition 
fillers"  or  they  can  be  used  to  augment  the  organization's  current  aircraft 
strength.  If  reserves  are  to  be  used  as  attrition  fillers,  they  are  committed 
on  an  as-needed  basis  to  replace  any  combat  losses  that  may  occur  during  the 
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FIGURE  4-1  EFFECT  OF  ATTRITION  ON  SORTIE  PROFILE 


day.  Ia  this  mode,  aot  all  reserves  may  be  committed  on  the  day  they  become 
available. 

If  the  augmentation  mode  is  selected,  then  all  reserve  aircraft  are 
committed  on  the  day  they  become  available;  hence,  the  size  of  the  force  may 
actually  increase  during  the  scenario.  An  example  of  this  situation  would  be 
a  scenario  in  which  a  squadron  is  deployed  after  the  outbreak  of  a  conflict  to 
join  a  wing  already  fighting  in-place. 

After  selecting  the  manner  in  which  reserves  are  to  be  used,  the  user 
also  specifies,  for  each  flying  day,  the  number  of  reserve  aircraft  that 
become  available  on  that  day.  The  reserves  are  committed  in  the  following 
manner:  if  the  user  specifies  ttu. X  reserve  aircraft  are  available  as  of  the 
nth  day,  then  immediately  after  the  last  flight  of  the  nth  day,  these  X  new 
reserves  are  added  to  the  current  reserve  pool.  Hext,  aircraft  from  this 
reserve  pool  are  used  to  replace  combat  losses  or  augment  the  current  aircraft 
strength.  In  either  case,  the  earliest  possible  sortie  that  any  of  these  X 
new  reserves  could  fly,  is  the  first  sortie  of  the  next  (i.e.,  the  (n  +  l)st) 
day. 
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5.  VALIDATION  EFFORTS 


INTRODUCTION 

The  purpose  of  this  chapter  is  to  describe  the  validation  efforts  which 
have  been  conducted  in  support  of  the  Sortie-Generation  Model  (SGM).  The 
Sortie-Generation  Model  is  only  one  part  of  a  system  of  models  that  includes 
the  SGM  Spares  Subsystem  and  the  SGM  Maintenance  Subsystem.  These  subsystems 
generate  spares  and  maintenance  data  bases  that  are  input  to  the  SGM.  In 
addition,  the  SGM  has  been  designed  to  model  a  variety  of  flying  scenarios  for 
many  different  tactical  aircraft  weapon  systems.  For  these  reasons  validation 
of  the  SGM  has  been  a  complex  task.  Extensive  tests  have  been  conducted; 
however,  this  validation  effort  is  not  complete.  For  the  weapon  systems  and 
scenarios  tested  thus  far,  the  SGM  has  provided  consistent  and  reasonable 
estimates  of  sortie-generation  capability. 

The  SGM  validation  effort  has  followed  the  general  framework  and  employed 
many  of  the  techniques  described  in  references  [12]  and  [15].  Our  effort  has 
been  conducted  in  three  phases.  First,  extensive  testing  was  conducted  to 
ensure  the  "correctness"  of  the  software  comprising  the  model.  Next,  analytic 
experiments  and  sensitivity  analyses  were  performed  to  verify  the  validity  of 
the  model  algorithms  and  approximations.  The  final  phase  was  to  examine  the 
adequacy  of  the  model  in  predicting  "real  system"  behavior.  The  following 
sections  of  this  chapter  describe  these  phases  in  more  detail. 

SOFTWARE  VERIFICATION 

The  first  step  in  any  validation  effort  for  a  large  simulation  model  is 
to  ensure  that  the  model  is  performing  as  designed  by  verifying  the  cor¬ 
rectness  of  the  model's  computer  programs.  Although  the  concept  is  quite 
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simple,  the  actual  task  of  "debugging"  a  large  software  program  is  tedious. 
Any  large,  complex  piece  of  software  should  always  be  used  with  caution.  A 
large  software  program  can  perhaps  never  be  considered  completely  bug-free; 
however,  it  should  be  designed  and  tested  in  a  manner  sufficient  to  instill 
confidence  in  the  model  user.  For  this  reason,  a  great  deal  of  effort  was 
devoted  to  the  design  and  testing  of  the  SGM  software  to  ensure  program  cor¬ 
rectness. 

Design  goals  in  the  development  of  the  SOM  included  such  software  en¬ 
gineering  techniques  as  modular  design,  structured  programming,  and  extensive, 
built-in  error  checking.  The  model  wa^  written  and  debugged  in  small  modules. 

Most  SQM  routines  are  one  page  in  length  and  none  are, more  than  three  pagea. 

",  \\  ' 

Although  the  SGM  is  written  in  FORTRAN,  structured  programming  was  enforced 
through  the  use  of  standard  IF-THEN-F.LSE  constructs  and  looping  operations. 
Finally,  the  SGM  contains  a  great  deal  of  what  might  be  called  "defensive 
programming".  Extensive  checks  with  error  messages  have  been  built  into  most 
of  the  SGM  routines.  A  more  detailed  discussion  of  these  SGM  design  goals  is 
contained  in  Volume  IV,  SGM  Programmer's  Manual. 

After  the  initial  development  of  the  SGM,  an  extensive  testing  phase  was 
conducted.  Each  SGM  module  was  read,  reviewed,  and  tested  by  an  "independent" 
programmer  or  analyst,  i.e.,  someone  other  than  the  original  designer  and 
coder.  An  interesting  and  important  by-product  of  this  phase  was  the  identi¬ 
fication  of  computational  bottlenecks  in  the  model.  As  part  of  the  testing 
procedure,  we  determined  the  amount  of  time  spent  in  each  of  the  model's 
various  processes  for  a  typical  SGM  run.  Once  the  most  time-consuming  pro¬ 
cesses  were  identified,  new  algorithms  were  developed  that  resulted  in  sig¬ 
nificant  improvements  in  the  model's  run  time. 
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VERIFICATION  OF  MODEL  ALGORITHMS  ASP  APPROXIMATIONS 

The  second  phase  of  the  validation  effort  consisted  of  devising  and 
conducting  experiments  to  test  the  validity  of  the  model's  algorithms  and 
approximations.  The  actual  implementation  of  the  model  design  involved  the 
use  of  various  approximations  to  achieve  reasonable  model  running  times  and 
memory  requirements. 

The  basic  approach  used  in  these  tests  was  to  design  model  scenarios  with 
enough  simplifying  assumptions  to  allow  us  to  calculate  analytically  what  the 
expected  answers  should  be.  The  model  was  run  with  these  simplifying  assump- 
tions  and  the  answers  compared  to  the  analytically  predicted  results.  A 
simple  example  of  this  approach  is  the  following  experiment  we  ran  to  test  the 
attrition  portion  of  the  model.  It  is  characteristic  of  a  constant  attrition 
rate  that  the  expected  total  number  of  sorties  flown  is  equal  to  the  total 
force  size  divided  by  the  attrition  rate.  Thus,  the  model  results  can  easily 
be  tested  by  comparing  the  actual  sorties  flown  with  the  predicted  result. 

Another  test  procedure  was  to  compare  the  model  results,  using  an 
algorithm  or  approximation,  to  another  more  detailed  simulation  of  the  same 
process.  The  alternative  simulation  used  was  either  an  entirely  different 
model  or  the  SGH  itself  with  a  more  detailed  implementation  of  the  algorithm 
to  be  tested.  These  detailed  implementations  were  adequate  for  testing  pur¬ 
poses;  however,  they  were  too  prohibitive  in  running  time  and  memory  require¬ 
ments  to  provide  any  practical  use.  This  phase  was  an  attempt  to  answer  the 
question,  "Given  the  underlying  assumptions  of  the  model  are  true,  does  the 
SGM  produce  results  that  are  consistent  with  those  assumptions?" 

During  this  phase,  we  also  performed  an  extensive  sensitivity  analysis  of 
the  model's  parameters  to  confirm  its  consistency  over  the  range  of  interest. 
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This  analysis  involved  a  large  number  of  SGM  runs  to  identify  those  parameters 
to  which  the  results  were  most  sensitive. 

PREDICTIVE  VALIDATION 

The  final  phase  of  our  validation  was  to  teat  the  model's  ability  to 
provide  a  reasonable  prediction  of  sortie-generation  capability.  Our  first 
step  was  to  compare  the  SGM  with  data  from  an  actual  Air  Force  sortie  surge 
exercise,  Salty  Rooster.  Next,  we  compared  the  SGM  with  other  sortie  models 
currently  in  use.  We  ran  SGM  comparison  tests  with  the  Air  Force  LCOM  model. 
The  remainder  of  this  section  describes  the  results  of  our  Salty  Rooster  and 
LCOM  tests. 


Salty  Rooster 


Salty  Rooster  was  a  sortie  surge  exercise  conducted  at  Hahn  AB, 
Germany  in  April  1978.  The  classified  results  of  this  exercise  are  contained 
in  [16].  The  first  four  days  of  this  exercise  offered  an  excellent  op¬ 
portunity  to  teat  the  predictive  capability  of  the  SGM.  The  SGM  scenario  used 
for  this  experiment  is  summarized  in  Figure  5-1  and  an  explanation  of  t.he 
scenario  and  results  follows.  (See  Volume  II,  SGM  User's  Guide,  for  defini¬ 
tions  of  SGM  scenario  parameters.) 

Salty  Rooster  Flying  Schedule.  We  used  the  SGM  to  attempt  to  fly 
the  first  four  days  of  the  Salty  Rooster  flying  schedule.  All  weather  cancel¬ 
lations  were  eliminated  from  the  schedule,  i.e.,  any  weather  cancellation  that 
occurred  was  treated  as  if  the  sortie  had  never  been  scheduled. 


Hahn  AB  F-4E  Maintenance  Data.  We  used  the  F-4E  maintenance  data 
collected  from  Hahn  AB  maintenance  tapes,  and  processed  these  data  through  the 
SGM  Maintenance  Subsystem  to  produce  aircraft  work  center  break  and  repair 
rates.  (See  Volume  V,  Maintenance  Subsystem  for  a  description  of  this 
process . ) 
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Salty  Rooster  Flying  Schedule,  Days  1-4 
Weather  Cancellations  Elimated 

F-4E  Maintenance  Data  Collected  From  Hahn  AB 
Work  Center  Break  Rates 
Work  Center  Service  Rates 

Salty  Rooster  Ground  Abort  Rate 

20  percent  Aircraft  Break  Rate 

Salty  Rooster  Initial  NMCM  Rate 

No  Manpower  Resource  Constraints 

No  Spares  Resource  Constraints 

FIGURE  5-1.  SGM  SCENARIO  FOR  SALTY  ROOSTER  TEST 

Ground  Abort  Rate.  We  used  the  actual  ground  abort  experienced 
during  the  first  four  days  of  the  exercise. 

Aircraft  Break  Rate.  We  did  not  have  an  F-4E  break  rate  for  Hahn 
AB.  However,  our  visit  to  the  F-4E  wing  at  Seymour  Johnson  indicated  that  a 
typical  F-4E  break  rate  ranged  from  IB  to  22  percent;  we  used  20  percent. 

Initial  NMCM  Rate.  We  used  the  same  initial  NMCM  rate  as  experi¬ 
enced  in  the  exercise.  The  appropriate  percentage  of  aircraft  were  distrib¬ 
uted  throughout  the  various  work  centers  at  the  start  of  the  flying  scenario. 

Manpower  Constraints.  We  assumed  for  this  experiment  that  whenever 
an  aircraft  broke  into  a  work  center  there  was  always  a  maintenance  crew 
available  to  begin  work  on  the  aircraft,  i.e.,  no  aircraft  queues  ever  formed 
in  the  work  centers.  This  assumption  was  made  because  maintenance  manpower 
was  never  a  limiting  factor  in  sortie  production  throughout  the  exercise. 
This  is  partially  due  to  the  fact  t^t  an  additional  250  maintenance  personnel 
were  brought  in  for  this  exercise.  In  addition,  the  Hahn  AB  maintenance 
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organization  was  already  over  100-percent  manned  before  the  augmentation.  The 
majority  of  the  personnel  worked  12-hour  shifts  during  the  exercise. 

Spares  Constraints.  We  assumed  that  enough  spares  were  available  bo 
that  no  aircraft  was  NMCS  during  the  first  four  days.  As  with  the  maintenance 
assumption,  no  detailed  spares  data  were  available  and  additional  spares  were 
brought  in  for  the  exercise.  The  WRSK  and  BLSS  at  the  base  were  augmented  to 
the  99-percent  level  for  the  exercise;  they  also  brought  in  a  special  BLSS  of 
390  line  items  consisting  of  over  13,000  items. 

Comparison  Results 

We  compared  the  SGM  predictions  using  the  scenario  described  versus 
the  actual  sorties  flown  during  the  first  four  days  of  Salty  Rooster.  Results 
were  compared  for  each  day  of  the  exercise  and  also  for  the  total  Borties 
flown  during  the  entire  four-day  exercise.  The  results  of  the  Salty  Rooster 
exercise  are  classified  Secret;  hence,  the  actual  numbers  cannot  be  shown 
here.  However,  the  SGM  results  were  remerkabiy  close  to  the  actual  sorties 
produced.  The  cumulative  four-day  total  was  within  one  percent  of  the  actual 
sorties  flown. 

Obviously  this  experiment  did  not  test  the  accuracy  of  the  model  in 
representing  the  effects  of  constraining  resources  on  sortie  production.  It 
also  didn't  test  its  accuracy  in  estimating  sustainability,  since  we  only 
looked  at  four  days.  However,  it  did  provide  a  means  for  judging  the  major 
mechanisms  in  the  model:  the  aircraft  maintenance  recovery  process  and  the 
break  and  ground  abort  processes.  The  results  of  this  test  provided  positive 
indication  that  these  processes  in  the  model  produce  reasonable  results. 
LOOM 

The  next  step  in  validating  the  SGM  was  to  run  it  against  the  Air  Force 
Logistics  Composite  (LCOM)  Model.  LOOM  is  an  extremely  powerful  and  complex 
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simulation  originally  developed  by  the  Air  Force  Logistics  Command  and  RAND 
during  the  mid  1960s.  This  model  is  used  extensively  throughout  the  Air  Force 
for  establishing  maintenance  manpower  requirements.  LOOM  has  itself  been  the 
subject  of  considerable  validation  effort  throughout  its  development  and  use; 
hence,  LOOM  was  a  natural  choice  for  comparison  with  the  SOM. 

To  conduct  this  comparison,  we  designed  a  flying  scenario  jointly  with 
the  LCOM  group  at  Headquarters  Tactical  Air  Command  (TAC).  Then  we  ran  the 
SGM  using  this  scenario  and  the  notional  F-4E  data  base  produced  by  the  SGM 
Maintenance  Subsystem.  TAC  ran  LCOM  using  the  same  scenario  and  the  LCOM  F-4E 
surge  data  base  which  is  a  composite  of  data  from  four  different  F-4E  bases. 
Thus,  this  experiment  provided  a  test  of  both  the  model  and  our  notional 
maintenance  data  base. 

The  actual  SGM  scenario  used  is  shown  in  Figure  5-2,  and  the  SGM  notional 
F-4E  data  base  is  shown  in  Figure  5-3.  Summaries  pf  the  common  inputs  and 
differences  for  this  experiment  are  shown  in  Figures  5-4  and  5-5.  Definitions 
of  LCOM  inputs  are  provided  in  [10].  A  discussion  of  this  test  scenario  and 
results  follows. 

Unit  Strength  (UE) .  Both  the  SGM  and  LCOM  used  a  UE-strength  of  46 
F-4E  aircraft.  This  is  not  a  standard  sized  F-4E  wing;  however,  the  SGM 
notional  base  was  developed  using  this  strength  to  facilitate  aggregation  of 
the  sortie  results  from  12  tactical  fighter  bases.  Thus,  46  represents  an 
"average"  base  in  thiB  sense. 

Flying  Schedule.  A  30-day  flying  schedule  of  six  equally-spaced 
waves  each  flying  day  was  used.  These  waves  were  spaced  2.5  hours  apart,  with 
a  constant  sortie  length  of  1.1  hours.  The  SGM  used  a  minimal  recovery  period 
of  0.5  hours.  The  LCOM  sortie  leadtime  and  cancellation  time  were  both  0.5 
hours.  A  sortie  leadtime  is  defined  as  the  amount  of  time  before  takeoff  when 
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SCHEDULE 
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30 
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0630  1630 
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0.40 

12.40 

RATES 

_ 

INITIAL  AIRCRAFT 

NMCM  RATE  ATTRITION  BREAK  RATE  GROUND-ABORT 

C.  0.  0.2000  0.0400 


INFINITE  SPARE  PARTS  ASSUMED  FOR  THIS  SOM  RUN. 

FIGURE  5-2.  SGM-LCOM  TEST;  SGM  SCENARIO 

work  should  begin  to  prepare  the  aircraft  for  launch.  The  cancellation  time 
is  the  amount  of  time  that  will  be  allowed  after  scheduled  takeoff  in  order 
for  the  aircraft  to  finish  all  presortie  tasks  and  takeoff  late.  The  LCQM 
aircraft  were  flown  in  a  "clean"  configuration,  i.e.,  without  external  fuel 
tanks,  ECM  pods,  bombs,  etc.,  to  facilitate  comparison  with  the  SGM  which  does 
not  model  these  items. 

Both  models  were  run  in  the  mass-launch  mode.  The  models  attempt  to 
fly  all  mission-capable  aircraft  for  each  wave  of  the  day. 

Attrition.  No  attrition  was  used  for  this  experiment;  hence,  no 
reserve  aircraft  were  used  either. 
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FIGURE  5-3.  SGM  F-4E  NOTIONAL  BASE 
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AIRCRAFT  MAINTENANCE  (Task  Structures,  Service  Rates,  Crew  Sizes) 

LCOM:  F-4E  Surge  Data  Base  (3-Ba.e  Average) 

SGM:  Notional  F-4E  Data  Base  (12-Baae  Average) 

AIRCRAFT  BREAK,  RATES 
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simulation  replications 

LCOM:  1 
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Initial  NMCM  Rate.  Both  models  assumed  all  aircraft  were  fully 
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mission-capable  at  the  start  of  the  scenario. 

Aircraft  Maintenance.  Both  models  used  the  same  work  centers  and 
manpower  authorizations,  i.e.,  those  for  the  SQM  notional  base  (shown  in 
Figure  5-3) .  This  decision  was  made  to  facilitate  comparison  between  the  two 
models. 

The  SQM  used  the  work  center  break  rates,  service  rates,  and  crews 
per  12-hour  shift  shown  in  Figure  5-3.  This  notional  maintenance  data  was 
developed  from  the  maintenance  data  collected  from  12  F-4E  bases.  (For  a 
description  of  the  construction  of  an  SGM  notional  base,  see  Volume  V,  Mainte¬ 
nance  Subsystem.) 

LOOM  used  TAC's  F-4E  surge  data  base  which  contained  detailed  net¬ 
work  description  of  maintenance  tasks  for  the  work  centers  being  modeled. 
This  surge  data  base  was  compiled  from  data  from  four  F-4E  bases.  LCOM  per¬ 
formed  only  unscheduled  maintenance;  no  phased  inspection  or  scheduled  main¬ 
tenance  was  performed. 

Thus,  in  summary,  LCOM  and  SGM  used  the  same  work  centers  and  man¬ 
power  authorizations,  but  different  crew  sizes,  service  rates  and  maintenance 
task  structures. 

Failure  Rates.  The  SGM  used  a  post-sortie  break  rate  of  0.20  and  a 
ground  abort  rate  of  0.04,  fairly  typical  rates  for  the  F-4E  in  a  surge  en¬ 
vironment.  LCOM  used  the  failure  clock  mechanisms  inherent  in  its  maintenance 
task  descriptions. 

It  is  unclear  what  the  corresponding  LCOM  break  and  ground-abort 
rates  are  in  that  all  of  this  information  is  implicit  in  the  various  LCOM 
failure  clocks  and  its  task  network.  However,  from  previous  experiments,  it 
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seems  that  the  equivalent  LCOM  break  rate  is  in  the  0.70  to  0.95  range.  This 
is  perhaps  the  most  startling  difference  between  LCOM  and  the  SGM. 

Simulation  Replications.  The  SGM  used  100  replications  of  the 
experiment  and  LCOM  only  one. 

Spares  Constraints.  Both  models  assumed  that  there  were  no  spares 
constraints,  i.e.,  adequate  spares  were  available  so  that  no  aircraft  was  ever 
NCMS.  This  assumption  was  made  because  no  comparable  list  of  spares  was 
available.  The  SGM  models  parts  at  the  NSN  level  while  LCOM  aggregates  parts 
into  higher  level  Work  Unit  Codes  (WUC). 

Comparison  of  Results.  The  objective  of  this  comparison  were  to 
test  again  the  major  mechanisms  of  the  SGM;  in  addition,  we  attempted  to  test 
our  notional  F-4E  base  for  aircraft  maintenance.  Again,  we  are  not  really 
testing  its  accuracy  in  estimating  sustainability  since  no  spares  were 
modeled. 

Two  simulation  runs  were  made  with  both  LCOM  and  the  SGM,  one  with 
constrained  maintenance  manpower  and  one  with  unconstrained  manpower.  By 
constrained  manpower  we  mean  that  the  work  centers  are  assumed  to  have  the 
authorized  maintenance  personnel  shown  for  the  SGM  F-4E  notional  base  in 
Figure  5-3.  Unconstrained  manpower  implies  that  there  are  enough  maintenance 
personnel  in  every  work  center  so  that  no  aircraft  ever  has  to  wait  for  a 
maintenance  crew.  The  results  of  these  runs  are  shown  in  Figure  5-6.  We  have 
graphed  the  average  number  of  sorties  flown  per  aircraft  for  each  day  of  the 
flying  scenario  and  also  computed  the  30-day  average  of  this  same  quantity. 
As  the  figure  indicates,  the  SGM  produces  a  much  higher  sortie  rate  than  LCOM 
for  both  the  constrained  and  unconstrained  cases. 

The  obvious  questions  are  what  are  reasonable  sortie  rates  for  this 
flying  scenario  and  why  is  the  SGM  so  much  higher  than  LCOM?  It  would  seem 
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that  one  would  expect  a  fairly  high  sortie  rate  for  this  scenario.  In  the 
unconstrained  case,  there  are  no  maintenance  manpower,  spares,  aircrew,  fuel, 
or  munitions  constraints;  all  aircraft  are  flying  clean,  so  there  are  no 
weapons  loading  delays.  In  this  highly  favorable  flying  environment,  the  LCOM 
sortie  rate  of  2.8  sorties  per  aircraft  per  day  seems  suspiciously  low,  es¬ 
pecially  when  compared  to  the  results  of  previous  sortie  surge  exercises.  In 
fact,  when  an  LCOM  comparison  was  made  with  those  results,  the  LCOM  results 
were  significantly  lower  than  the  actual  sorties  flown. 

We  feel  that  the  primary  cause  of  the  lower  LCOM  rate  is  the  in¬ 
herent  difference  between  the  LCOM  and  SGM  post~sortie  break  rates.  The  SGM 
used  a  0.20  break  rate;  our  visits  tro  the  F-4E  wing  at  Seymour  Johnson  AFB 
indicated  an  F-4E  break  rate  ranging  between  0.18  to  0.22.  Fcevious  LMI 
experiments  with  other  LCOM  data  bases  indicated  that  the  LCOM  rate  inherent 
in  the  LCOM  network  and  its  numerous  failure  clocks  was  up  in  the  range  0.7  to 
0.95.  In  fact,  when  we  doubled  the  SGM  break  rate,  i.e.,  0.4  instead  of  0  2, 
we  obtained  sortie  rates  of  2.5  and  2.3  for  the  unconstrained  and  constrained 
manpower  cases,  respectively. 

Thus,  we  feel  the  LCOM  comparison  was  inconclusive.  The  LCOM  rate 
was  surprisingly  low,  and  we  conjecture  that  it  is  caused  by  the  inherently 
higher  LCOM  post-sortie  break  rate. 
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RANDOM  SAMPLING  TECHNIQUES 

The  SGM  requires  the  generation  of  random  variates  according  to  various 
probability  distributions.  The  methods  used  uy  the  SGM  were  carefully 
selected  according  to  such  criteria  as  CPU  time,  memory  requirements,  and 
numerical  and  statistical  accuracy.  The  following  paragraphs  provide  a  brief 
description  and  appropriate  reference  for  each  sampling  method. 

BINOMIAL 

Binomial  samples  are  generated  using  a  combination  of  two  methods.  For 
smaller  means,  i.e.,  less  than  4.0,  a  set  of  Bernoulli  samples  is  generated; 
for  larger  mean?  an  inverse  transform  approach  is  used.  These  methods  are 
described  in  [4:418-423]. 

MULTINOMIAL 

Multinomial  samples  are  generated  based  on  a  technique  known  as  the  Alias 
method.  This  method  is  described  in  [11:214-218], 

NORMAL 

A  Central  Limit  approach  is  used  for  generating  normal  variates.  Twelve 
uniformly  distributed  random  variates  are  summed  to  produce  a  normal  sample. 
This  method  is  described  in  [13:92-93]. 

POISSON 

Poisson  samples  are  generated  using  a  combination  of  two  methods.  For 
Poisson  distributions  with  large  means,  i.e.,  greater  than  20,  samples  are 
generated  using  a  normal  distribution  with  continuity  correction  as  an  ap¬ 
proximation  of  the  Poisson.  For  smaller  means,  a  combination  of  exponentially 
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distributed  samples  is  used  to  generate  the  Poisson  sample.  Those  two  methods 
are  described  in  [3:147-156], 

UNIFORM  (0,  1) 

The  SGM  uses  the  random  number  generator  supplied  from  the  Honeywell 
Statistics  Library.  This  generator  uses  a  mixed  congrueutial  method  and  is 
described  in  ( 7 : ST194-ST195 ] . 
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